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A version of the Dynamical Systems Gradient Method for solving ill-posed nonlinear 
• monotone operator equations is studied in this paper. A discrepancy principle is pro- 

posed and justified. A numerical experiment was carried out with the new stopping 
rule. Numerical experiments show that the proposed stopping rule is efficient. Equa- 
tions with monotone operators are of interest in many applications. 
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^ ! 1 Introduction 

O . 

0^ . In this paper we study a version of the Dynamical Systems Method (DSM) (see |10| ) for 

solving the equation 

F(u) = /. (!) 



where F is a nonlinear, twice Frechet differentiable, monotone operator in a real Hilbert 
space H, and equation (pQ) is assumed solvable, possibly nonuniquely. Monotonicity means 
that 

(F(u) -F(v),u- v) > 0, Vu,veH. (2) 

Equations with monotone operators are important in many applications and were studied 
extensively, see, for example, [5], [7], [21], [23], and references therein. One encounters 
many technical and physical problems with such operators in the cases where dissipation of 
energy occurs. For example, in [9] and [8], Chapter 3, pp. 156-189, a wide class of nonlinear 
dissipative systems is studied, and the basic equations of such systems can be reduced to 
equation (pQ) with monotone operators. Numerous examples of equations with monotone 
operators can be found in [5] and references mentioned above. In [19] and [20] it is proved 
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that any solvable linear operator equation with a closed, densely defined operator in a 
Hilbert space H can be reduced to an equation with a monotone operator and solved by 
a convergent iterative process. 

In this paper, apparently for the first time, the convergence of the Dynamical Systems 
Gradient method is proved under natural assumptions and convergence of a corresponding 
iterative method is established. No special assumptions of smallness of the nonlinearity or 
other special properties of the nonlinearity are imposed. No source-type assumptions are 
used. Consequently, our result is quite general and widely applicable. It is well known, that 
without extra assumptions, usually, source-type assumption about the right-hand side, or 
some assumption concerning the smoothness of the solution, one cannot get a specific rate 
of convergence even for linear ill-posed equations (see, for example, [10] . where one can 
find a proof of this statement). On the other hand, such assumptions are often difficult to 
verify and often they do not hold. By this reason we do not make such assumptions. 

The result of this paper is useful both because of its many possible applications and 
because of its general nature. Our novel technique consists of an application of some new 
inequalities. Our main results are formulated in Theorems 1171 and 1191 and also in several 
lemmas, for example, in Lemmas El HI El EJ CEH [12J Lemmas El IH [Til E2] may be useful in 
many other problems. 

In [23] a stationary equation F(u) = f with a nonlinear monotone operator F was 
studied. The assumptions A1-A3 on p. 197 in |23j are more restrictive than ours, and 
the Rule R2 on p. 199, formula (4.1) in [23] for the choice of the regularization parameter 
is quite different from our rule and is more difficult to use it computationally: one has 
to solve a nonlinear equation (equation (4.1) in [23J) in order to find the regularization 
parameter. To use this equation one has to invert an ill-conditioned linear operator A + al 
for small values of a. Assumption Al in [23] is not verifiable practically, because the 
solution X' is not known. Assumption A3 in [23] requires F to be constant in a ball 
B r {x^) if F'(x*) = 0. Our method does not require these assumptions, and, in contrast to 
equation (4.1) in [23], it does not require inversion of ill-conditioned linear operators and 
solving nonlinear equations for finding the regularization parameter. The stopping time 
is chosen numerically in our method without extra computational effort by a discrepancy- 
type principle formulated and justified in Theorem 1171 in Section EJ We give a convergent 
iterative process for stable solution of equation (1.1) and a stopping rule for this process. 

In [23] the "source- type assumption" is made, that is, it is assumed that the right- 
hand side of the equation F(u) = f belongs to the range of a suitable operator. This 
usually allows one to get some convergence rate. In our paper, as was already mentioned 
above, such an assumption is not used because, on the one hand, numerically it is difficult 
to verify such an assumption, and, on the other hand, such an assumption may be not 
satisfied in many cases, even in linear ill-posed problems, for example, in the case when 
the solution does not have extra smoothness. 

We assume the nonlinearity to be twice locally Frechet differentiable. This assumption, 
as we mention below, does not restrict the global growth of the nonlinearity. In many 
practical and theoretical problems the nonlinearities are smooth and given analytically. In 
these cases one can calculate F' analytically. This is the case in the example, considered in 
Section HI This example is a simple model problem for non- linear Wiener- type filtering (see 
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[18J). If one drops the nonlinear cubic term in the equation Bu + n 3 = / of this example, 
then the resulting equation Bu = f does not have integrable solutions, in general, even 
for very smooth /, for example, for / G C°°([0, 1]), as shown in [18]. It is, therefore, of 
special interest to solve this equation numerically. 

It is known (see, e.g., [TO]), that the set M := {u : F(u) = /} is closed and convex if 
F is monotone and continuous. A closed and convex set in a Hilbert space has a unique 
minimal-norm element. This element in M we denote by y, F{y) = f. We assume that 

sup \\FW(u)\\<Mj(R), 0<j<2, (3) 

\\u—uq\\<R 

where uq G H is an element of H, R > is arbitrary, and / = F(y) is not known but fg, 
the noisy data, are known, and \\fg — f\\ < 5. Assumption ([3]) simplifies our arguments 
and does not restrict the global growth of the nonlinearity. In [12] this assumption is 
weakened to hemicontinuity in the problems related to the existence of the global solutions 
of the equations, generated by the DSM. In many applications the nonlinearity F is given 
analytically, and then one can calculate F'(u) analytically. 

If F'(u) is not boundedly invertible then solving equation (fT]) for u given noisy data fg 
is often (but not always) an ill-posed problem. When F is a linear bounded operator many 
methods for stable solving of (P) were proposed (see [2], [1]-[TO] and references therein). 
However, when F is nonlinear then the theory is less complete. 

DSM consists of finding a nonlinear map $>(£, u) such that the Cauchy problem 

u = $>(t,u), u(0) = no, 

has a unique solution for all t > 0, there exists lim^oo u(t) := u(oo), and F(u(oo)) = f, 

3! u(t) Vt > 0; 3u(oo); F(u(oo)) = f. (4) 

Various choices of $ were proposed in [TO] for @ to hold. Each such choice yields a version 
of the DSM. 

The DSM for solving equation ([T]) was extensively studied in [TO]-[I7]. In [TO], the 
following version of the DSM was investigated for monotone operators F: 

ug = -{F'{u s ) + a{t)l)~ 1 (F{u s ) + a{t)ug- fg), u 5 (0) = u . (5) 

Here / denotes the identity operator in H. The convergence of this method was justified 
with some a priori choice of stopping rule. 

In [22] a continuous gradient method for solving equation ([T]) was studied. A stopping 
rule of discrepancy type was introduced and justified under the assumption that F satisfies 
the following condition: 

\\F(x)-F(x)-F'(x)(x-x)\\=r]\\F(x)-F(x)\\, r? < 1, (6) 

for all x, x in some ball B(xq,R) C H. This very restrictive assumption is not satisfied 
even for monotone operators. Indeed, if F'{x) = for some x G B(xq) then ([6]) implies 
F(x) = f for all x G B(xq,R), provided that B(xq,R) contains a solution of (P). 
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In this paper we consider a gradient- type version of the DSM for solving equation ([T|): 

u s = -(F'(usT + a{t)l)(F(us)+a(t)us-fs), u s (0) = u Q , (7) 

where F is a monotone operator and A* denotes the adjoint to a linear operator A. If 
F is monotone then F'(-) := A > 0. If a bounded linear operator A is defined on all of 
the complex Hilbert space H and A > 0, i.e., {Au,u) > 0, Vu G -ff, then ^4 = A*, so ^4 
is selfadjoint. In a real Hilbert space H a bounded linear operator defined on all of H 
and satisfying the inequality (Au, u) > 0, Vu £ H is not necessary selfadjoint. Example: 

H = R 2 ,A=(^ ^j, (Au,u) =2uj + Ul u 2 + u 2 2 >0, but A* = (J fj ^ A. 

The convergence of the method © for any initial value uo is proved for a stopping rule 
based on a discrepancy principle. This a posteriori choice of stopping time tg is justified 
provided that a(t) is suitably chosen. 

The advantage of method ((7|), a modified version of the gradient method, over the 
Gauss-Newton method and the version © of the DSM is the following: no inversion of 
matrices is needed in ([7]). Although the convergence rate of the DSM ([7]) maybe slower 
than that of the DSM ©, the DSM (J7J) might be faster than the DSM © for large-scale 
systems due to its lower computation cost at each iteration. 

In this paper we investigate a stopping rule based on a discrepancy principle (DP) for 
the DSM (UJ. The main results of this paper are Theorem 1171 and Theorem 1191 in which 
a DP is formulated, the existence of a stopping time tg is proved, and the convergence of 
the DSM with the proposed DP is justified under some natural assumptions. 

2 Auxiliary results 

The inner product in H is denoted (u, v) . Let us consider the following equation 

F(Vg) + aV 5 -fs = 0, a> 0, (8) 

where a = const. It is known (see, e.g., [10], [2S]) that equation ([8]) with monotone 
continuous operator F has a unique solution for any fg £ H. 
Let us recall the following result from |10j : 

Lemma 1 Assume that equation (JH) is solvable, y is its minimal-norm solution, assump- 
tions (|2|) holds, and F is continuous. Then 

lim \\V a - y\\ = 0, 

£1^0 

where V a solves © with 5 = 0. 

Of course, under our assumption (J3j), F is continuous. 

Lemma 2 If ^ holds and F is continuous, then \\Vg\\ = O(-) as a oo, and 

lim \\F(V s )-fs\\ = \\F(0)-fs\\. (9) 
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Proof. Rewrite © as 

F(V S ) - F(0) + aV 5 + F(0) - /, = 0. 

Multiply this equation by tyj, use inequality (F(Vg) — F(0), Vs — 0) > and get: 

a||^|| 2 <||/ 5 -F(0)||||^||. 

Therefore, || 1| = O(-). This and the continuity of F imply ([9j). □ 

Let a = a(t) be strictly monotonically decaying continuous positive function on [0, 00), 
< a(t) \ 0, and assume a S C 1 [0,cxd). These assumptions hold throughout the paper 
and often are not repeated. Then the solution Vs of (jSJ) is a function of t, V5 = V#(i). 
From the triangle inequality one gets: 

\\F(V 5 (0)) - fe\\ > \\F(0) - Ml - ||J(^(0)) - F(0)||. 

From Lemma [2] it follows that for large a(0) one has: 

\\F(V 5 (0)) - F(0)\\ < M^Vsm = °C^j\ 

Therefore, if \\F(0)-f s \\ > CS, then \\F(V s (0))- f s \\ > (C-e)5, where e > is sufficiently 
small and a(0) > is sufficiently large. 

Below the words decreasing and increasing mean strictly decreasing and strictly in- 
creasing. 

Lemma 3 Assume ||.F(0) — fs\\ > 0. Let < a(t) \ 0, and F be monotone. Denote 

m := \\V s (t)\\, 4>{t) := a{t)m = \\F(V s (t)) - f s \\, 

where V$(t) solves ([8]) with a = a(t). Then <p(t) is decreasing, and ip{t) is increasing. 

Proof. Since ||F(0) - f s \\ > 0, one has i/t(t) + 0, Vt > 0. Indeed, if 4>(t)\ t=T = 0, then 
Vs(t) = 0, and equation (J8|) implies ||F(0) — fs\\ = 0, which is a contradiction. Note that 
<f>(t) = a(t)\\V s (t)\\. One has 

< (F(V 5 (h)) - F(V s (t 2 )), V 5 (h) - V 5 (t 2 )) 
= (-a(h)V s (ti) + a(t 2 )V s (t 2 ), V s (h) - V s (t 2 )) (10) 
= (o(ti) + a{t 2 )){V s {t x ), V s (t 2 )} - a{tx)\\Vs{h)\\ 2 - a(t 2 )\\V s (t 2 )\\ 2 . 

Thus, 

< (a{h) + a(fc))[|V,(ti)[|[| V,(t a )[| - aihWsWf - a(t 2 )\\V 8 (t 2 )\\ 2 
= (a(ti)||^(ti)|| - a(t 2 )\\V 5 (t 2 )\\)(\\V 5 (t 2 )\\ - WVit^W) (11) 

= (#1)- <j>{t 2 ))m 2 ) - ^h)). 
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If ip(t 2 ) > ip(h) then ((IT]) implies (j>(t x ) > (j)(t 2 ), so 

a(tMh) > a(i 2 )V(*2) > a(t 2 )^(ti). 

Thus, if ipfa) > i^(ti) then a(t 2 ) < a(ii) and, therefore, t 2 > ii, because a(t) is strictly 
decreasing. 

Similarly, if tp(t 2 ) < ift(ti) then <j)(t\) < 4>{t2)- This implies a(t 2 ) > a(ti), so t 2 < t\. 
Suppose ijj(ti) = ip(t 2 ), i.e., ||Vtf(ti)|| = ||Vy(t 2 )||. From (JED, one has 

ii^(ti)ii 2 < (Vs(h),v 5 (t 2 )) < immm^w = im^f. 

This implies Vs(t\) = Vs(t 2 ), and then equation ([8]) implies a(t\) = a(t 2 ). Hence, t± = t 2 , 
because a(t) is strictly decreasing. 

Therefore 4>(t) is decreasing and ip(t) is increasing. □ 

Lemma 4 Suppose that ||-F(0) — /,5|| > C5, C > 1, and a(0) is sufficiently large. Then, 
there exists a unique t\ > such that \\F(Vs(ti)) — fs\\ = C5. 

Proof. The uniqueness of t\ follows from Lemma [3] because ^(^(t)) — f§\\ = 4>(t), and 
(f> is decreasing. We have F(y) = f, and 

= (F(V 5 ) + aV s - f S , F(V 5 ) - fs) 
= \\F(V S ) - f s f + a(V s - y,F(V s ) - f s ) + a(y,F(V s ) - fs) 
= \\F(V S ) - fsf + a(V s - y, F(V S ) - F(y)) + a(V s -y,f-fs)+ a(y, F(V S ) - fs) 
> \\F(Vs) - fsf + a(V s -y,f-fs) + a(y, F(V S ) - fs). 

Here the inequality (Vs — y,F(Vs) — F(y)) > was used. Therefore 

\\F(Vs) - fsf < ~a(Vs -y,f-fs)- a(y, F(V S ) - fs) 

< a\\V s - y\\\\f - f s \\ + a||y||||F(^) - f s \\ (12) 
<aS\\V 5 -y\\+a\\y\\\\F(V s )-fs\\. 

On the other hand, we have 

= (F(Vs) - F(y) + aV s + f- fs, V 5 - y) 
= (F(Vs) - F(y), V s -y) + a\\V s - y\\ 2 + a(y, V s - y) + (/ - fs, V 5 - y) 
> a\\V s - 2/M 2 + a(y, V s - y) + (f - f 5 , V s -y), 

where the inequality (Vs — y,F(Vs) — F(y)) > was used. Therefore, 

a\\V s - y\\ 2 < a\\y\\\\V s - y\\ + 5\\V S - y\\. 

This implies 

a\\V s - y\\ < a\\y\\ + 5. (13) 
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Prom (fT2|) and (fT3|) . and an elementary inequality ab < ea? + |-, Ve > 0, one gets: 



- h\V <S 2 + a\\y\\5 + a\\y\\\\F(V s ) - Ml 



1 2,u,,2 ( 14 ) 



< ^ + a||y||<? + e||F(Va) - f s \\ 2 + — a J ||y|| 2 , 

4e 

where e > is fixed, independent of t, and can be chosen arbitrary small. Let t — > oo and 
a = a(t) \ 0. Then (JT2J) implies 

lim Woo (l - e)||F(y tf ) - M| 2 < $ 2 - 

This, the continuity of F, the continuity of on [0, oo), and the assumption ||-F(0) — 
Ml > C5 imply that equation ||F(V^(i)) — Ml = C5 must have a solution t% > 0. The 
uniqueness of this solution has already established. □ 

Remark 5 From the proof of Lemma H] one obtains the following claim: 
If t n y oo then there exists a unique n\ > such that 

\\F(V ni+1 ) - M| <C6< \\F(V ni ) - M|, V n := V S (t n ). 

Remark 6 From Lemma [2] and Lemma [3] one concludes that 

a n \\V n \\ = \\F(V n ) - Ml < \\F(0) - /ill, a n :=a(t n ), Vn > 0. 

Remark 7 Let 1/ := V5(t)|j = o, so 

F(V) + a(t)V - f = 0. 

Let y be the minimal-norm solution to equation ([I]). We claim that 

\\V S -V\\<-. (15) 
a 

Indeed, from © one gets 

F(F 5 ) - F(V) + a(V s -V) = f-f s . 
Multiply this equality with (Vs — V) and use the monotonicity of F to get 

a\\V 5 -V\\ 2 <<y||Vf-V||. 
This implies (|15|) . Similarly, multiplying the equation 

F(V) + aV-F(y) = 0, 
by V — y one derives the inequality: 

\\v\\ < hi (is) 

Similar arguments one can find in |10| . 

From (|15p and (|16p . one gets the following estimate: 

\\V s \\<\\V\\ + -<\\y\\ + -. (17) 
a a 
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Lemma 8 Suppose a(t) = r c + t \b > <f{t) = Jo ^r~ds where b & (0, j], d and c are positive 
constants. Then 

d 2 f 2b \ I' 1 e^ 
Proof. We have 

- jf W^W" = 2(1^25) (< c + ( > 1_2 ' " c " 2t ) - *< c + <>° " <*■ < 19 > 

where 9 := 1 — 26, p := C3 := pc 61 . One has 

d e p(c+t) e p6e p( - c+ V 9 be p( - c+ V e 



dt(c + t) b (c + t) b + 1 - 9 (c + i)^ 1 

e p(c+t)0 / d 2 b 



(c + t) b \2(c + t) 2b c + t 

P (c + t)<> d 2 / 2b 

> ~, ^T~, T7TT { 1 



(c + t) b 2(c + t) 2b V c e (i 2 



Therefore, 



f* eP(c+s)e j C d eP(c+s)e a 

~2 V 1 " -Jd 2 ) J JsTcj^ ~ Jo ds-Jc~TsT bdS 



e P(c+tf e pc" e p(c+t) 

< TV ^ < 



6 ' 



(c + t) b c b - (c + t) 

Multiplying this inequality by e~ Ci and using (fl9j) . one obtains (fl~8|) . Lemma [8] is proved. 
□ 

Lemma 9 lei a(t) = and tp(t) := / * ^|^ds w/iere d, c> 0, 6 G (0, ±] and c x - 2b d 2 > 

6b. One has 

e -rt) f e^)\a(s)\\\V s (s)\\ds < ±a(t)\\V e (t)\\, * > 0- (20) 
Jo z 

Proof. From Lemma [HI one has 

®) fe^) d3 da<e <p(t)d_ Vc,6>0, = 1-26>O. (21) 
2 V c 8 d 2 JJ {s + c) 3b (c + t) 6 ' ~ v ; 

Since c x ~ 2h d 2 > 66 or < 1, one has 



26 46 46 

" ^2 " (c + s) 1 " 2 ^ 2 ' S -°' 
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This implies 

,3^ / 2b 



d 3 



2(c + s) 



2b 
Jd? 



> 



Mb 



2(c + s)^ 1 



2|d(s)|, s>0. (22) 



Multiplying (f2Tj) by ||V^(i)|| 3 using inequality ([22]) and the fact that ||V5(t)|| is increasing, 
one gets, for all t > 0, the following inequalities: 



e^a(t)\\V 5 (t)\\> f e^ s) \\V s (t)\\^ 



2b 

Jd? 



ds>2 e^ s) \h{s)\\\V 5 {s)\\ds. 



□ 



This implies inequality (|20p . Lemma [9] is proved. 

Let us recall the following lemma, which is basic in our proofs. 

Lemma 10 ( [10J , p. 97) Let a(t), f3{t), ~f(t) be continuous nonnegative functions on 
[to, oo), to > is a fixed number. If there exists a function 

fj, G C^^oo), A* > 0, lim /i(t) = oo, 

t^oo 



such that 



< a(t) < 
/x(0) 5 (0) < 1, 



7' 



tit) 
nit) 

tit) 
tit) 



dfi 



and g{t) > satisfies the inequality 

g(t) < --y(t)g(t) + a{t)g 2 {t) + (3(t), t > t , 
then g(t) exists on [to,oo) and 



< git) < 



tit) 



0, as t — > oo. 



(23) 

(24) 
(25) 

(26) 
(27) 



If inequalities (|23p - (|25p hold on an interval [to,T), then git) exists on this interval and 
inequality (1271) holds on [to,T). 

Lemma 11 Suppose Mi, eg, and c\ are positive constants and ^ y G H. Then there 
exist A > and a function ait) G C^fO, oo), < a(t) \ 0, such that 



\a(t)\ < 



a 3 (t) 
4 ' 



9 



and the following conditions hold 



\\y\\ 

c {M 1 + a(t)) < 



2o?{t) 



2™ 2|d(t)| 



Mi < ^1 
1 a(t) " 2A 

A 5(0) <1- 



a 2 (i) - 



a(t) 
2\a(t)\ 



Proof. Take 



a(t) 



a 2 (0) 



rf 



(c + t) fe; 
Note that Idl = —a. We have 



< b < -, 46 < c 1 " 2 ^ 2 , c > 1. 



b 1 
< _ . _ < _. 



J 3 d2( c + i)l-26 - d 2 c l-26 - 4 



Hence, 



« 2 W / „2™ 2|d(t)| 



< a\t) 



a{t) 



Thus, inequality ([29]) is satisfied if 



co(Mi + a(0)) < -. 



Take 



A > max ( 8cqMi, 



A 



Mi 

IMI 



Then ([28]) is satisfied and 

c M 1 < -. 

For any given g(0), choose a(0) sufficiently large so that 

A 



a 2 (0) 



5(0) < 1. 



Then inequality (|3Tj) is satisfied. 
Choose k > 1 such that 



, /4Aci6 8c a(0) 
K > max | a / — - — , : , 1 I • 



Define 



ci 4 ' A 
u(t) := Ka(t), A K := k 2 \ 



(28) 
(29) 
(30) 
(31) 

(32) 



(33) 

(34) 
(35) 
(36) 



(37) 
(38) 
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Using inequalities ([36]) . ([37]) and ([38]) . one gets 

co(M! + 1/(0)) < ^ + co^(0) < ^ + ^ = ^. 

Thus, flM]) holds for o(t) = u(t), A = A K . Consequently, ([29]) holds for a(t) = u(t), A = A K 
since (|33p holds as well under this transformation, i.e., 

Using the inequalities ([37]) and c > 1 and the definition ([38]) . one obtains 



This implies 

|£j z/(t) ^ 2 (t) 
V(t) " 4A K " 2A K 

Thus, one can replace the function a(t) by z/(i) = Ka(t) and A by A K = k 2 A in the 



9 2 U> 
1/ — 



inequalities ([28|> - (|3lp . □ 

Lemma 12 Suppose M\,cq,cx and a are positive constants and ^ y £ H . Then there 
exist A > and a sequence < (a n )^L \ such that the following conditions hold 

"" <2, (40) 



||/ 5 -^(0)|| (41) 

f < IMI, (42) 

coC^+ao) < 1 (43) 
A 2 

2-4 2 

a n aa n a n — a n+ i a n+1 

-r rr- H c\ < — — . (44) 

Proof. Let us show that if oq > is sufficiently large, then the following sequence 

a " = (rrV' b= \> (45) 

satisfies conditions (|4ip - (|44p if 

A > max (j^- , 4cqMi^ . (46) 



Condition ([40]) is satisfied by the sequence ([45]) . Inequality ([42]) is satisfied since ([46]) 
holds. Choose a(0) so that 

ao > {/||/ 5 -F(0)||A, (47) 
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then (|4ip is satisfied. 

Assume that (a n )£L and A satisfy (SOD, (HU) and . Choose k > 1 such that 



It follows from (SHI) that 



Define 



K >ma X (^J^J^). (48) 



< &, < a. (49) 



(6„)£=o := K)" o, A K := k 2 X. (50) 
Using inequalities (j46l) , (j48l) and the definitions (|50l) , one gets 



cp (Mi + bp) 1 coao 1 1 = 1 
A K _ 4 kA _ 4 4 2' 

Thus, inequality (l43l) holds for ao replaced by 6q = koo and A replaced by A K = k 2 X, where 



k satisfies (jl8|) . 

For all n > one has 

„2 _ 2 4 _ 4 n 4 -n 4 ^_ i i 

"n u n+l _ u n "n+l < u n a n+l _ n+l n+2 _ 1 < 1 /[--i \ 

Since a n is decreasing, one has 



4 _ 4 

a n ~ An+l a n a n+l 



a 4 a n+ i a 4 a n+ i(a n + a n+ i)(a 2 + a 2 +1 ) 

n 4 _ 4 <4_ -, 

< °" A n+1 = n+ \ n t 2 < — A , Vn>0. 
" 4a 4 a 4 +1 4 J^J^ -4a 4 ' 

n+2 n+l 



(52) 



Using inequalities (f5Tj) and (|49p . one gets 

4(a 2 - a 2 +1 ) 



2„4 



K*a. 



< -j-zr-m < «• (53) 



Similarly, using inequalities ([52]) and (09]), one gets 

4A(a n - a n+ i)ci Aci 

< -5-i ^ «• ( 54 ) 

Inequalities (|53j) and (f54"l) imply 

~~ , ^« ~~ a n ~~ a n+l , a n ~~ a n+l 

\ + Cl = \ + Cl 

_ K 2 a*4:(al -a 2 n+ i) K 2 a 4 4A(a w - gn+Qci 
4A /i 2 a 4 4A K 2 a 4 a n+ i 

94 94 94- ~?4 

k a„ k a„ K rata ab„ 

< -a H -a = — = — -. 

- 4A 4A 2A 2A K 
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Thus, inequality ([33]) holds for a ri replaced by b n = na n and A replaced by \ K = k 2 A, where 
k satisfies (I48p . Inequalities (I40p - (I42|) hold as well under this transformation. Thus, the 

choices a n = b n and A := k max ( AcqMi^J , where k satisfies (|48p. satisfy all the 

conditions of Lemma [121 □ 



Remark 13 The constant Co and ci used in Lemma [TT1 and [121 will be used in Theorems [T71 
and 1191 These constants are defined in equation (|67|) . The constant a, used in Lemma [12} 
is the one from Theorem [19] This constant is defined in ffi)4 



Remark 14 Using similar arguments one can show that the sequence a n = t^xb > where 

c>l,0<6<i, satisfy all conditions of Lemma H] provided that d is sufficiently large 
and A is chosen so that inequality (|46|) holds. 

Remark 15 In the proof of Lemma [12] and [11] the numbers ao and A can be chosen so 

a? 

that -j- is uniformly bounded as 8 — > regardless of the rate of growth of the constant 
Mi = Mi(R) from formula @ when R — > oo, i.e., regardless of the strength of the 
nonlinearity F(u). 

To satisfy flU one can choose A = Mi (A + 4c ). To satisfy dHJ) one can choose 



oo= W||/-F(0)|| + 11/11) > ^A||/ 5 -F(0)||, 
where we have assumed without loss of generality that < ||/<5 — /|| < ||/||. With this 

a 2 

choice of ao and A, the ratio is bounded uniformly with respect to 8 € (0, 1) and does 
not depend on R. The dependence of ao on 5 is seen from (|4"T|) since fg depends on 5. In 
practice one has \\f$ — f\\ < \\f\\. Consequently, 

nfs-F(0)\\*< - ^(0)|| + ||/||)A. 

Thus, we can practically choose a(0) independent of 5 from the following inequality 



a > ^A(||/-F(0)|| + 



Indeed, with the above choice one has 2a < c(l + v 7 ^) < c, where c > is a constant 
independent of 8, and one can assume that A > 1 without loss of generality. 

This Remark is used in the proof of the main result in Section [3] Specifically, it is 
used to prove that an iterative process (I93p generates a sequence which stays in the ball 
B(uq, R) for all n < uq + 1, where the number no is defined by formula (|104p (see below), 
and R > is sufficiently large. An upper bound on R is given in the proof of Theorem 
[191 below formula (fTT7|) . 

Remark 16 One can choose uq £ H such that 

II V II < 

go ■= N - Vb || < • (55) 

a 
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Indeed, if, for example, uq = 0, then by Remark [6] one gets 

ii t ^ ii ooiivbii < \\m -f s \ 

9o = \\V \\ = < 



a a 
If gH) and dM} hold then 5o < — • 

3 Main results 

3.1 Dynamical systems gradient method 

Assume: 

0<a(i)\0, Hm^ = 0, ^<\. (56) 
t->oc a{t) a (t) 4 

Denote 

A := F'(ug(t)), A a :=A + aI, a = a(t), 
where I is the identity operator, and ug(t) solves the following Cauchy problem: 

ug = -A* a ^[F(us) + a(i)ug - fg], ug(0) = u . (57) 

Theorem 17 Assume that F : H — ^ H is a monotone operator, twice Frechet differen- 
liable, su VueB(u0iR) \\FW(u)\\ < M 5 {R), < j < 2, B(u ,R) := {u : ||u - n || < R}, u 
is an element of H, satisfying inequality (|88|) (see below). Let a(t) satisfy conditions of 
Lemma [771 For example, one can choose a(t) = t^\b > where 6 £ (0, |], c > 1, and d > 
are constants, and d is sufficiently large. Assume that equation F(u) = f has a solution 
in B(uo,R), possibly nonunique, and y is the minimal-norm solution to this equation. Let 
f be unknown but fs be given, \\f$ — f\\ < 6. Then the solution ug(t) to problem (f5Tj) exists 
on an interval [0,Tg], lim^o^ = oo, and there exists tg, tg £ (0,Tg), not necessarily 
unique, such that 

\\F(ug(tg)) - fg\\ = d5<, lim tg = oo, (58) 

o— >0 

where C\ > 1 and < £ < 1 are constants. If £ € (0, 1) and tg satisfies (|58[) . £/ien 

]im\\ug{tg)-y\\=0. (59) 
5^0 



Remark 18 One can easily choose no satisfying inequality (|88p . Note that inequality 
([55]) is a sufhcient condition for ([§1]) to hold. In our proof inequality (|9"Tj) is used at t = tg. 
The stopping time tg is often sufficiently large for the quantity e~^ ts ^ho to be small. In 
this case inequality (|91|) with t = tg is satisfied for a wide range of uo- The parameter £ is 
not fixed in (|58p . While we could fix it, for example, by setting £ = 0.9, it is an interesting 
open problem to propose an optimal in some sense criterion for choosing £. 



Proof. [Proof of Theorem 1 17| Denote 



C := (60) 
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Let 

w := us - Vs, g(t) := \\w\ 

One has 



w = -V 5 - A* a(t) [F(u s ) - F(V S ) + a(t)w] . (61) 



We use Taylor's formula and get: 



M 2„. „2 



F(ui) - F{V S ) + aw = A a w + K, \\K\\ < ^\\w\\ z , ( 62 ) 

where K := F(us)— F(Vs) — Aw, and M2 is the constant from the estimate (|3"]). Multiplying 
(f6"T1) by u; and using (f62l) one gets 



^<-aV + M2( ^ +a) g 3 + lN| g , (63) 

where the estimates: {A* a A a w, w) > a 2 g 2 and ||Aj|| < M\ + a were used. Note that the 
inequality (A* A a w, w) > a 2 g 2 is true if A > 0. Since F is monotone and differentiable 
(see pj), one has 4 := > 0. 

Let to > be such that 

() ' 11 ", C>1. (64) 



a(t ) C-1 IIWI " 

This to exists and is unique since a(t) > monotonically decays to as t —* 00. By 
Lemma HI there exists ti such that 

\\F(Vs{h)) - f 5 \\ = Cd, F(V 6 (t 1 )) + a(t 1 )V 5 {t 1 )-f 6 = 0. (65) 

We claim that t\ G [0,to]- 

Indeed, from (jSJ) and (fT7j) one gets 



C(5 = a(ti)||V 4 (t 1 )||<o(ti)n|y|| + ^-y) r/(/ t )||/y| + f ;> i . 

so 

5< o(*0l|l/|| 



C-l 
Thus, 

* < Ibll 



a(h) ~ C-l a(t )' 

Since a(t) \ 0, the above inequality implies t\ < to- Differentiating both sides of dH) with 
respect to t, one obtains 

A a (t)Vs = -aV s . 

This implies 



\\Vs\\ < \a\\\A-^V s \\ < l -^\\Vs\\ <^(\\ y \\ + -)< l -f\\y\\[l + ^—A, Vt < t . (66) 



15 



Since g > 0, inequalities (|63|) and (|66j) imply 

<?< -a 2 (t)<7(t)+co(M 1 + a(t)) 9 2 + ^ji Cl , cq = ci = ||y|| I 1 + -^-j ) (07) 
Inequality ([57]) is of the type ([25]) with 

7 (t) = a 2 (t), a(t) = cq(Mi + o(t)), /3(i) = c x 



a(t) 

Let us check assumptions (f2"5j) - (|2"5"j) . Take 

li>(t) = „, s i A = const. 
PV ; a 2 (t) 

By Lemma [TT1 there exist A and a(t) such that conditions ([23j) - ([25]) hold. Thus, Lemma 
[10] yields 

g(t) < ii£ Vt < t - (68) 

Therefore, 

II^M*)) - M| <\\F(u s (t)) - F(V s (t))\\ + ll*W(*)) " Ml 

<M ig (t) + \\F(V 5 (t))-f s \\ (6g) 

<^^+im^(*))-/,sii, vt<t . 

It follows from Lemma[3]that — fg\\ is decreasing. Since t\ < to, one gets 

\\F(V s (t )) - f s \\ < WFiVsih)) - f s \\ = CS. (70) 

This, inequality (f69j) . the inequality ^ < ||y|| (see (j35|) ). the relation (fM|) . and the 
definition C x = 2C - 1 (see flEQJ)) imply 

ll^(*d))-MI <^5)+C5 



We have used the inequality 



2/ x <5(C-1) 
a 2 (t ) < a(t ) = 



llyll 

which is true if 8 is sufficiently small, or, equivalently, if to is sufficiently large. Thus, if 

\\F(u s {0)) - f s \\ > Crf, 0<C<1, 
then there exists t§ G (0, to) such that 

\\F(u s (t s ))-f s \\=Crf (72) 
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for any given ( G (0,1], and any fixed C\ > 1. 

Let us prove (|59p . If this is done, then Theorem 17 is proved. 



First, we prove that lim^o = 0. 



_5_ 

its 

From (|69p with t = t$, and from (|17p . one gets 

C 1 5C<M 1 ^M + (t i )||^(t a )|| 
<M 1 ^|^ + ||y|Ki 5 ) + 5. 
Thus, for sufficiently small 5, one gets 



^<a(t,)(^W + ||y||]. r>0. 



where C < C\ is a constant. Therefore, 



lim — - < lim v ; + ||y|| =0, < C < 1. (73) 



5->o a(ts) s^o C V ^ 
Secondly, we prove that 



limi,5 = oo. (74) 
5^0 



Using (|57j) . one obtains: 

— + a«5 - /^) = A a n 5 + dus = -A a A* a (F(us) + au s - fs) + ai^. 

This and (jSJ) imply: 

^ - F(V*) + a(n 5 - V 5 )} = -A a A* a [F(u 5 ) - F(V 5 ) + a(u 5 - V s )] + au s . (75) 

Denote 

v := F{u s ) - F(V S ) + a{u s - V s ), h = \\v\\. 
Multiplying (|75p by v and using monotonicity of F, one obtains 



hh = —(A a A*v,v) + (v,a(u s - V s )) + a{v,V s ) 

r, r, (76) 

< -h 2 a 2 + h\a\\\u s - V s \\ + \a\h\\V s \\, h>0. 



Again, we have used the inequality A a A^ > a 2 , which holds for A > 0, i.e., monotone 
operators F. Thus, 

h<-ha 2 + \a\\\u s -Vs\\ + \a\\\Vs\\. (77) 
Since {F(u$) — F(Vs),us — Vs) > 0, one obtains two inequalities 

a\\u 5 -V s \\ 2 < (v,u s -V s ) < \\u s -V s \\h, (78) 
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and 

\\F(u 5 ) - F(V 5 )\\ 2 < (v,F(u 5 )-F(Vs)} < h\\F(u s ) - F(V S )\\. (79) 
Inequalities (|78l) and (j79l) imply: 



a\\u s -V s \\ <h, \\F(u 5 )- F(V s )\\<h. (80) 
Inequalities ([77]) and ([80]) imply 



a 



h<-h(a 2 -^)+\h\\\V s \\. (81) 



Since a 2 — — > ^ > ^ by the last inequality in (|56l) , it follows from inequality (|HTj) that 

h<~h+\a\\\V s \\. (82) 

Inequality ([82]) implies: 

h(t) < h(0)e- 1° ^ ds + e~ Jo ^ ds e fo ^ d «|d(s)|||y 5 (s)||ds. (83) 

JO 

Denote 

¥>(*) : = ^ ^y^ds. 

Prom US3D and ([HP]) , one gets 

\\F(u s (t))-F(V s (t))\\<h(0)e-^+e-W f e^\a(s)\\\V 5 (s)\\ds. (84) 

J o 

Therefore, 

\\F(u s (t)) -f 5 \\> \\F(V 5 (t)) - M| - \\F(V 5 (t)) - F(u s (t))\\ 

> a{t)\\V s (t)\\ - h(0)e~ v ® - e~ v ® [ e^ s) \a\ \\V s \\ds. 

Jo 

From Lemma [9] it follows that there exists an a(t) such that 



2 „2 



where c\,c > 0. Moreover, one can always choose uq such that 

h(0) = \\F(u ) + a(0)n - < ^(0)11^(0)11, 

18 



(85) 



^a(t)||Vj(t)|| > e-*W f e^\a\\\Vs(s)\\ds. (86) 



For example, one can choose 

a ^=(^ip be(0,- 4 ], c\c^ h > 66, (87) 



because the equation 

F(«o) + a(0)n - f S = 



is solvable. 

If OSS) holds, then 



^(0)e-^)<ia(0)||y a (0)||e-^), 



i > 0. 



If ([87D holds, c > 1 and 2b < c\ , then it follows that 

e~ v(t) a(0) < o(t). (90) 

Indeed, inequality a(0) < a(t)e^ is obviously true for i = 0, and (a^e^W). > 0, 
provided that c > 1 and 26 < cf . 
Inequalities ([89]) and ([50]) imply 

e-**)*(0) < Jo(0[|Vi(0)[| < io(0||Vi(0||, « > 0. (91) 

where we have used the inequality ||V#(i)|| < ||^5(i')|| for t < i', established in Lemma[3l 
From ([72]) and ([85} - (j9l]) . one gets 

CS< = \\F( Us (ts)) - f s \\ > \a(ts)\\V 6 (t s )\\. 

Thus, 

hma(ts)\\V s (t s )\\ < lim4C<5 c = 0. 

Since ||V^(i)|| is increasing, this implies lim^o a (*5) = 0. Since < a{t) \ 0, it follows 
that CSD holds. 

From the triangle inequality and inequalities (|68p and (j!5|) one obtains 

IM*«) - v\\ < WMts) - v s \\ + \\v(t s ) - v s (t s )\\ + \\v(t s ) - y \\ 

< a 2 {U) 5 (92) 

From (|73h . (174p . inequality (I92j) and Lemma [T] one obtains (]59p . Theorem 1171 is proved. 
□ 

3.2 An iterative scheme 

Let V n s solve the equation: 

F(V ni5 ) + a n V ntS -f S = 0. 

Denote V n := K,<5- 

Consider the following iterative scheme: 

u n +i = u n ~ a n A* n [F(u n ) + a n u n - f s ], A n := F'(u n ) + a n I, u = uq, (93) 
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where uq is chosen so that inequality ([55]) holds, and {«„}™ =1 is a positive sequence such 
that 

2 

< a < a n < -2, \\A n \\ < Mi + a n . (94) 

< + (Mi+a n )^ 

It follows from this condition that 

||1 - a n A* an A a J\ = sup |1 - a n X\ < 1 - a n a^. (95) 

al<\<(Mi+a n )2 

Note that F'(u n ) > since F is monotone. 

Let a ra and A satisfy conditions (f4*0|) - (f4"4"|) . Assume that equation F(u) = f has a 
solution in B(uq,R), possibly nonunique, and y is the minimal-norm solution to this 
equation. Let / be unknown but f$ be given, and \\fg — /|| < 5. We prove the following 
result: 

Theorem 19 Assume a n = where c > 1, < b < | } and d is sufficiently large so 



that conditions (140p -( l44j) ZioW. Let ii n 6e defined by (J93])- Assume that uq is chosen so 
that (|55p holds. Then there exists a unique n$ such that 

\\F(u ns ) - f 5 \\ < C^, < ||F(u„) - Ml, Vn < n 5 , (96) 

where C\ > 1, < C < 1- 

Let < (<5 m )^ =1 6e a sequence such that 5 m — ► 0. // £/ie sequence {n m := n$ m }^ =1 is 
bounded, and {n mj }^ =1 is a convergent subsequence, then 

lim «n m , = u, (97) 

where u is a solution to the equation F(u) = f . If 

lim n m = oo, (98) 

m—foc 

where C £ (0, 1), then 

lim \\u nm - y\\ = 0. (99) 

m— >oo 

Proof. Denote 

C := ^±1. (100) 

Let 

Z ra . — ti n V^, , <7n • — || 2 n 1 1 . 

We use Taylor's formula and get: 

Mo o 

F(u n ) - F(V n ) + a n z n = A n z n + K n , \\K n \\ < — -\\z n f , (101) 

where K n := F{u n ) - F(V n ) - F'(u n)z n and M2 is the constant from (|3|). From (|93p and 
(|101|) one obtains 

z n+ i = z n - a n A* n A n z n - a n A* n K(z n ) - (V n+1 - V n ). (102) 
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(103) 



From (fT02"j) . (fTUT]) . (j95|) . and the estimate ||A„|| < Mi + a n , one gets 

. |h d * . || J anM 2 (Mi+Q w ) 2 „ TA 

5n+l < 5n||l - at n A n A n || H # n + ||K n +i - Kill 

. n 2 , , a n M 2 (M l + a n ) 2 
< 3„(1 - a n a n ) H g n + ||K+i - K||- 

Since < a n \ 0, for any fixed 5 > there exists no such that 

— > 7^-rlMI > — > C>1. (104) 

Ono+l u — 1 a no 
By (@0D, one has ^ < 2, Vn > 0. This and <HM\ imply 

' W > ^->-i- > ? ^- r W>A C>L (105) 
o — i a no flny+i u — i a no 

Thus, 

||y||>— , Vn<n + 1. (106) 
u — i a n 

The number no, satisfying (|106p . exists and is unique since a n > monotonically decays 
to as n — > oo. By Remark [5l there exists a number n\ such that 

\\F(V m+1 ) - f 5 \\ <C5< \\F(V ni ) - Ml, (107) 

where V n solves the equation F(V n ) + a n V n — fs = 0. 
We claim that n\ 6 [0, no]. 

Indeed, one has ||-F(KJ - Ml = a njKill, and || || < ||y|| + (cf. (HZ])), so 

C<5< ^11^11 < a n J \\y\\ H J = a n Jy|| +5, C > 1. (108) 



Therefore, 
Thus, by (fTMjh 



5 < ^M. (109) 

- < J*!L < — ■ (no) 

Aril O — 1 Ctn +1 

Here the last inequality is a consequence of (|105p . Since a n decreases monotonically, 
inequality (jllOp implies ni < no- One has 

an+l||K - Vn+l\\ 2 = ((On+1 - On)K - -F(K) + F(V n+ i),K - K+l) 

< {(a n+ i - a n )V n , V n - K+i) (HI) 

< ifln ~ a n+ {)\\V n \\\\V n ~ V n+ i\\. 



21 



By (HB, \\V n \\ < \\y\\ + £, and, by (fT06|) . £ < §2| for all n < n + 1. Therefore, 

M < llvllfl+^^-j-J, Vn<n + 1, (112) 

and, by (fTTTD . 

||K - Fn+ill < Qn ~ ° W+1 ||y»[| < ^ = ° n+1 IMI f 1 + tt^t) , Vn<no + l. (113) 
a n+1 a n+ i \ u — 1/ 

Inequalities (I103p and (|113|) imply 

ffn+i < (1 - oL n a\)g n + a n co(Mx + a n )g 2 + — — ^±Ici, Vn<n + 1, (114) 



where the constants Co and ci are defined in (|67l) . 

By Lemma U] and Remark [Til the sequence (a n )^ 1; satisfies conditions (|40p 
provided that ao is sufficiently large and A > is chosen so that (l46l) holds. Let us show 
by induction that 

a 2 

5n<y, 0<n<n + l. (115) 

Inequality (|115p holds for n = by Remark [TBI Suppose (|115p holds for some n > 0. 
Prom (fTTT|) . (fTT5j) and (gU), one gets 

2 / 2 \ ^ 

^ C1 2 n a n , ( 11 j- , \( a n\ . a n ~ a n+l 

9n+i < (1 - a n aj— + a n c (Mi + a n ) — H ci 

A V A / a n+ i 



a n ( a nCo(M 1 +a n ) \ 4 , a « _ a n+l 

a n + -r H c i 



A V ^ / A «n+l 

4 2 
OL n (X n CL n CL n Q-n+l 

- — oT~ + ~r H Cl 

za A a n+ i 



(116) 



< 



a 



n+l 



Thus, by induction, inequality (|115p holds for all n in the region < n < no + 1. 
From (fT7|) one has UK 1 1 < ||y|| + This and the triangle inequality imply 

\\uq -u n \\ < \\uq\\ + \\z n \\ + \\V n \\ < \\uq\\ + \\z n \\ + \\y\\ H . (117) 

an 

Inequalities (|112|) . ()115j) . and (|117p guarantee that the sequence u n , generated by the 
iterative process (j93j) . remains in the ball B(uo,R) for all n < no + 1, where R < ^ + 
ll u oll + l|y|| + ;r:- This inequality and the estimate (I106P imply that the sequence u n , 
n < no + 1, stays in the ball B(uq, R), where 

an ,, C + 1 . 

i2< y + ||«o|| + 112/11 + IMI^ry- ( 118 ) 



22 



By Remark 1151 one can choose ao and A so that ^ is uniformly bounded as 5 — ► even if 
Mi(R) — > oo as R — > oo at an arbitrary fast rate. Thus, the sequence u n stays in the ball 
B(uq, R) for n < no + 1 when 5^0. An upper bound on R is given above. It does not 
depend on 5 as 5 — ► 0. 
One has: 

II^K) - Ml <||^M - n^)|| + ||^(K) - Ml 

<M ign + \\F(V n )-f s \\ (119) 
<^^ + ||F(K)-M|, Vn<n + 1, 

where (I115P was used and Mi is the constant from ([3]). Since ||F(V^) — Ml is decreasing, 
by Lemma O and n\ < no, one gets 

||F(K +l) - Ml < \\F(V ni+1 ) - M| < C«5. (120) 

From (g2D, (fTT9|) . (fT20l) . the relation (HMD , and the definition Ci = 2C - 1 (see (fTOOjl ). 
one concludes that 



\F(u no+1 )-f s \\<^^ + C5 



(121) 



< wy-i) +crg < ^-1)5=^8. 

x \\y\\ 

Thus, if 

\\F(u ) - M| > C x 8^ < C < 1, 
then one concludes from ()12ip that there exists n$, < n$ < n-o + 1, suc/i i/iai 

||F(n n J-M| < < ||FK)-M|, 0<n<n 5 , (122) 

/or any gu>en £ G (0, 1], and any fixed C\ > 1. 
Let us prcwe ([97|) . 

If n > is fixed, then us, n is a continuous function of fg. Denote 

u := u N = limus,n m] , (123) 

where 

lim n m = N. 
From (|123p and the continuity of F, one obtains: 

||F(u) - M| = lim ||FK ) - M| < lin. i C^ = 0. 

Thus, n is a solution to the equation F(u) = f, and ([97]) is proved. 
Let us prove (j99|) assuming that (f98|) holds. 
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From (|96p and ()119[) with n = ns — 1, and from (|122p . one gets 

a 2 a 2 _ 

< Mx^-i + a n ,-i||y na _i|| < Mi^-i + HylK-i + 5. 

If 5 > is sufficiently small, then the above equation implies 

where C < Ci is a constant, and the inequality ajL_i < a ns -iao was used. Therefore, by 

(HOD, 



lim < lim < lim — — — — + \\y\\ =0, < C < 1. (124) 



In particular, for 5 = 5 m , one gets 



lim = 0. (125) 

5 m -»o a n 



From the triangle inequality and inequalities (|15p and (|115p one obtains 

IK m - 2/ 1 1 < \\u nm ~ V n J\\ + ||K - V nm fl\\ + ||K m ,0 ~ y\\ 



a 



2 



S m , „„ , (126) 



<^ + — + IIK m ,o-y||. 

A a n m 



From ([98j) . (|125p . inequality ()126[) and Lemma [H one obtains ([99]) . Theorem [191 is proved. 
□ 



4 Numerical experiments 

Let us do a numerical experiment solving nonlinear equation ([1]) with 

F(u) := B{u) + — := / eH^^y)^ + -, /(x) := - - e"* - -. (127) 
6 Jo 6 6 e 



Such equation is a model nonlinear equation in Wiener-type filtering theory, see [18J. 

One can check that u(x) = 1 solves the equation F(u) = f. The operator B is compact 
in H = L 2 [0, 1]. The operator u i — > u 3 is defined on a dense subset D of of L 2 [0, 1], for 
example, on D := C[0, 1]. If u, v G -D, then 

(u 3 - i; 3 , it - v) = / (u 3 - w 3 )(u - v)cfe > 0. 
Jo 



Moreover, 

e -M = I / _! 

vr / m 1 + A 2 
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Therefore, {B(u — v),u — v) > 0, so 

(F(u-v),u-v) > 0, Vu,v£D. 
Note that D does not contain subsets, open in H = L 2 [0, 1], i.e., it does not contain 

3 

interior points of H. This is a reflection of the fact that the operator G(u) = ^ is 
unbounded on any open subset of H. For example, in any ball ||n|| < C, C = const > 0, 
where ||it|| := ||u||l2[o,i], there is an element u such that ||w 3 || = oo. As such an element 
one can take, for example, u(x) = c\x~ b , w < b < i. here c\ > is a constant chosen 
so that < C. The operator u i — * F(u) = G(u) + B(u) is maximal monotone on 
Dp ■= {u : u G H, F(u) E H} (see [U p. 102]), so that equation (jHJ) is uniquely solvable 
for any f 5 £ H. 

The Frechet derivative of F is: 

F l ( u )h=^— + / e- |z - y| %)(fy. (128) 
2 Jo 

If «(x) vanishes on a set of positive Lebesgue's measure, then F'(u) is obviously not 
boundedly invertible. If u £ C[0, 1] vanishes even at one point xo, then F'(u) is not 
boundedly invertible in H. 

Let us use the iterative process (f93|) : 



u n+1 =u n - a n (F'(u n )* + a n l)(F(u n ) + a„n n - f s ), 
n = 0. 

We stop iterations at n := n$ such that the following inequality holds 

\\F(u ns ) - f s \\ < C#, ||F(n n ) - M| > C^, n<n,5, C > 1, Ce(0,l). (130) 

Integrals of the form J Q e~\ x ~ y \h{y)dy in (|127p and (|128p are computed by using the 
trapezoidal rule. The noisy function used in the test is 

fs(x) = f(x) + Kf noise (x), k > 0. 

The noise level 5 and the relative noise level are determined by 

^ = K ll f noise \\ j $rel := • 

In the test, k is computed in such a way that the relative noise level 5 re i equals to some 
desired value, i.e., 

S = S rel \\f\\ 

1 1 f noise \\ 1 1 f noise \ \ 

We have used the relative noise level as an input parameter in the test. 

The version of DSM, developed in this paper and denoted by DSMG, is compared with 
the version of DSM in [3], denoted by DSMN. Indeed, the DSMN is the following iterative 
scheme 

u n +i = u n ~ A~ 1 {F'(u n ) + a n u n - fs), u = u , n > 0, (131) 
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where a n = This iterative scheme is used with a stopping time ns defined by ([96]) . 

The existence of this stopping time and the convergence of the method is proved in [3] . 

As we have proved, the DSMG converges when a n = h^tb , b G (0, j], and ao is 
sufficiently large. However, in practice, if we choose ao too large then the method will use 
too many iterations before reaching the stopping time ng in (|130|) . This means that the 
computation time is large. Since 

\\F(V 5 ) - f s \\ = a(t)\\Vs\\, 
and \\Vs(ts) - ug(tg)\\ = 0(a(tg)), we have 

Crf = \\F(ug(tg)) - f s \\ ~ a(tg). 

Thus, we choose 

a = C o c , C > 0. 

The parameter ao used in the DSMN is also chosen by this formula. 

In all figures, the x-axis represents the variable x. In all figures, by DSMG we denote 
the numerical solutions obtained by the DSMG, by DSMN we denote solutions by the 
DSMN and by exact we denote the exact solution. 

In experiments, we found that the DSMG works well with a = C <5 C , C G [0.2, 1]. 
Indeed, in the test the DSMG is implemented with a n := Cq ( n+1 )0.^5 , Co = 0.5 while the 

£0.99 

DSMN is implemented with a n := Co £qrn > Cq = 1. For Co > 1 the convergence rate of 
DSMG is much slower while the DSMN still works well if C G [1,4]. 

Figure [T] plots the solutions using relative noise levels 5 = 0.01 and 5 = 0.001. The 
exact solution used in these experiments is u = 1. In the test the DSMG is implemented 
with a n = 1, C = 1.01, C = 0.99 and a n = 1, Vn > 0. The number of iterations of the 
DSMG for 5 = 0.01 and 5 = 0.001 were 49 and 50 while the number of iteration for the 
DSMN are 9 and 9, respectively. The number of node points used in computing integrals 
in (I127p and (|128p was N = 100. The noise function f no i S e m this experiment is a vector 
with random entries normally distributed of mean and variant 1. Figure Q] shows that 
the solutions by the DSMN and DSMG are nearly the same in this figure. 

Figure [2] presents the numerical results when N = 100 with 5 = 0.01 u{x) = sin(27rx), 
x G [0,1] (left) and with 6 = 0.01, u(x) = sin(7rx), x G [0,1] (right). In these cases, the 
DSMN took 11 and 7 iterations to give the numerical solutions while the DSMG took 512 
and 94 iterations for u(x) = sin(2-7T2;) and u(x) = sin(7rx), respectively. Figure [2] show 
that the numerical results of the DSMG are better than those of the DSMN. 

Numerical experiments agree with the theory that the convergence rate of the DSMG 
is slower than that of the DSMN. It is because the rate of decaying of the sequence 
{ — ^t}$£Li is much slower than that of the sequence {•jij}JJLi. However, if the cost for 

evaluating F and F' are not counted then the cost of computation at one iteration of the 
DSMG is of 0{N 2 ) while that of the DSMN in one iteration of the DSMN is of 0{N 3 ). 
Here iV is the number of the nodal points. Thus, for large scale problems, the DSMG 
might be an alternative to the DSMN. Also, as it is showed in Figure [21 the DSMG might 
yield solutions with better accuracy. 
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Figure 1: Plots of solutions obtained by the DSMN and DSMG when N = 100, u = 1, 
x E [0, 1], 5 rd = 0.01 (left) and N = 100, u = 1, x G [0, 1], 5 rd = 0.001 (right). 



Experiments show that the DSMN still works with a r , 



^ for \ < b < 1. So in 
practice, one might use faster decaying sequence a n to reduce the time of computation. 

From the numerical results we conclude that the proposed stopping rule yields good 
results in this problem. 
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